The band recorded the EP in June 2009.[1] Kelly announced its title in August, noting that the band had come up with the title and cover art ten years previous and intended to use it for a debut 7-inch that was never recorded (the band's first release was the album A Guided Tour of Chicago):
When my band, the Lawrence Arms, first started, we had this idea for a seven inch. We had the title picked out and we even knew what the cover was gonna be. We promised ourselves that our first seven inch would have this name and this cover. Well, we never did a seven inch (except for one that was part of a label series, which meant that the cover and the title were sort of more beholden to the big picture rather than our dumb ideas) and the whole thing kind of languished, and now, ten years later, in conjunction with our ten year anniversary show and subsequent west coast run (the first run in over 2 years), we've got our first real seven inch on our hands. And guess what? We fucking named it the name that we thought up ten years ago.[2]
The EP's release date and cover art were announced the following week.[3] It was released both as a 7-inch vinyl record and as a digital download, the latter including an extra song.[2] The band supported the release with a tenth anniversary performance in October 2009 at the Metro Chicago, followed by a seven-date headlining tour of Arizona and California the following month with Teenage Bottlerocket and Cobra Skulls.[4][5] The tracklisting for the physical release was announced on October 5, 2009.[6][7]